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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1)13 Responsive to communication(s) filed on 20 October 2003 . 
2a)D This action is FINAL. 2b)E3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) I3 Claim(s) 38-57 and 59-62 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) D Claim(s) 38-40. 43-57. 59. 60. and 62 is/are rejected. 

7) D Claim(s) 41.42 and 61 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 185(a). 

11) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) Q Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a)DAII b)Q Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) Q Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 1 9(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 . 

Attachment(s) 

1) □ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) Paper No(s). . 

2) H Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-152) 

3) □ Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) □ Other: 
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DETAILED ACTION 

Allowable Subject Matter 

The indicated allowability of claims 59-62 is withdrawn in view of the newly 
discovered reference(s). Rejections based on the newly cited reference(s) follow. 

Claims 41 , 42 and 61 are objected to as being dependent upon a rejected base 
claim, but would be allowable if rewritten in independent form including all of the 
limitations of the base claim and any intervening claims. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 38-41, 43-47, 48-54 and 62 are rejected under 35 U.S.C. 103(a) as 

being unpatentable over Ahmed (6,263,507) in view of Vora et al (5,819,273) and 

Ahn (5,696,963). 

Considering claim 59, Ahmed discloses a system which extracts keywords and 
keyframes and generates summary stories by categorizing the segments of news into 
various categories. Ahmed discloses selecting a multimedia presentation as a story 
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segment. In particular, Ahmed discloses selecting a story from the clarinet news 
service, and to categorize the news story in to a subject category (e.g., sports, travel, 
computers, international news etc., see col 30 lines 5-10). Ahmed further discloses 
classifying text news into categories (see col 29 lines 53-55), and that a user can search 
using keywords or keyframes (see col 15 lines 43-61 and col 16 lines 56-67). It should 
be noted that since keywords and keyframes are categorized, i.e. sports, travel, 
computers, etc, that keywords and keyframes are inherently extracted from the text 
information stream corresponding to the story segment. It should also be noted that the 
keywords sports, travel, computers, international news etc. meet the claimed "named 
entities" location, i.e., sports or travel is a "named entity". Ahmed further discloses a 
user can search named entities by selecting a named category, like sports, news, travel, 
computers etc. (see col 30 lines 5-10, col 15 lines 34-39). Ahmed further discloses in 
response to a user search for headline news, presenting a list of named entities for 
headline news, i.e. "Insurer's Eye Erin's Costs", "Turkey insurers face major food 
payouts" and "Erin: A tropical Storm". In addition, by searching headline news, a listing 
of more "Headline News" is provided (see fig 2B and item 212, 213). 

Ahmed fails to disclose presenting a corresponding number of occurrences in 
story segments over a selected time period. Vora teaches a system in which a user can 
search articles in a database by selecting a cut of date prior to which no documents are 
to be retrieved and in which the system ranks documents according the number of 
keywords present would enable a user to view the most relevant articles (col 10 lines 
49-65). Ahn teaches displaying the number of hits of keywords appearing in a 
documents searched by a user (see Abstract). It would have been obvious modifying 
Ahmed to include the claimed limitations would have enable a user to retrieve and view 
the most relevant documents. Therefore, it would have been obvious to one having 
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ordinary skill in the art at the time the invention was made to modify Ahmed, based on 
the teachings of Vora and Ahn to include the claimed limitations to enable a user to 
retrieve and view the most relevant documents. 

Considering claims 38 and 47, Ahmed discloses the steps of extracting text data 
from the received stream which is used to compile a summary, Ahmed discloses 
"extracting text information from a text information stream corresponding to the story 
segment as text data" and "extracting story summary data from the text data (see col 33 
line 49 - col 34 line 39). Ahmed further discloses linking together a stored 
representation of the text data, summary data and name entity data (news, sports, 
travel, and "Erin: A Tropical Storm" meets the claimed 'named entity data' and 'text 1 and 
'summary 1 data are met by the data description of "Erin: A Tropical Storm"). Ahmed 
also discloses, in response to a search query, selecting multiple contiguous portions of 
the multimedia presentation as story segments and displaying multiple summary 
elements representative of the extracted story segments (see fig 2-b which displays 
multiple stories wherein each story has multiple elements including the title, description, 
time and location, and col 15 lines 25-50). 

Considering claim 39, Ahmed discloses storing the all the data including 
summary data, named entity data for story segments as one or more files one a file 
server (file server met by "data storage device 104" in fig 1). Further, the server is 
connected to the Internet which meets the "computer network" limitation (see col 1 1 
lines 1-7 and lines 40-65). Further, since a user can "browse" the data and categories, 
Ahmed discloses the claimed "allowing access to the stored representations of news 
story segments available to a browser program running on the client computer 
connected to the network' (see col 1 1 lines 31-65). 
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Considering claim 40, Ahmed discloses classifying text news into categories (see 
col 29 lines 53-55), and that a user can search using keywords or keyframes (see col 15 
lines 43-61 and col 1 6 lines 56-67). It should be noted that since keywords and 
keyframes are categorized, i.e. sports, travel, computers, etc, that keywords and 
keyframes are inherently extracted from the text information stream corresponding to 
the story segment. It should also be noted that the keywords sports, travel, computers, 
international news etc. meet the claimed "named entities" location, i.e., sports or travel 
is a "named entity". 

Considering claim 43, Ahmed discloses a method of selecting at least one 
contiguous portion of the multimedia presentation as a story segment by comparing 
observed cues to a threshold cues (see col 28 lines 25-35, also see col 17 lines 25-41 
and col 18 lines 25-40). 

Considering claim 44, Ahmed discloses the claimed keyframe (see col 16 lines 
56-67). 

Considering claim 45, Ahmed discloses wherein the claimed "wherein the story 
segment contains a reporter segment and the key frame is selected from the middle of 
the reporter segment (see col 24 lines 37-41 , the phrase "we go now to" or "more on 
that" is the middle of a reporter segment). 

Considering claim 46, Ahmed discloses the claimed "wherein the story segment 
contains an anchor booth segment and the keyframe is selected from the middle of the 
anchor booth segment" (see col 24 lines 37-41, phrases "we go now to", "update from" 
or "more on that" meets the claimed middle of the anchor booth segment). 

Considering claim 48, Ahmed discloses the plurality of elements of the story 
displayed together including the title, description, time and location (see fig 2-b). 
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Considering claim 49, Ahmed discloses the name of the summary (see "Erin: A 
Tropical Storm" in fig 2-b; sports, news, travel as discussed above, and 'Clarinet' in col 
30 lines 5-10) and thus discloses the claimed limitation. 

Considering claim 50, Ahmed discloses the claimed "summary of sentences" 
(see description of "Erin: A Tropical Storm" in fig 2-b). 

Considering claim 51, Ahmed discloses the claimed summary presentation 
elements comprise a hyperlink to a source media element of the segment (see fig 2-b, 
hyperlinks 213 and 214 take user to source of information). 

Considering claim 52, Ahmed discloses the claimed hyperlinks which lead to 
presentation of additional elements of the story segment including named entities (see 
fig 2-b, selecting "Headline News" leads to headline news stories and selecting the 
sports link 215 leads to sports news, stories and named entities). 

Considering claims 53, 54 and 62, Ahmed discloses selecting a hyperlink for 
searching for related stories and presenting a thumbnail view comprising keyframes 
from the multiple story segments (see fig 2-b, by selecting "Headline News", news under 
"Headline News" is searched and retrieved and displayed including the "Headline News" 
keyframe 213 and multiple story segments 214). 

Claims 55-57 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Ahmed (6,263,507) in view of Vora et al (5,819,273) and Ahn (5,696,963), as 
applied to the claims above, and further in view of Youman et al (5,629,733). 

Regarding claim 55, claim 55 recites some of the same limitations as recited 
above, and thus is rejected for at least those reasons provided above. Claim 55 further 
recites presenting a plurality of related story segments using a layered hierarchical 
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presentation of the summary representations at a relatively high hierarchical level and 
the source data at a relatively low hierarchical level, together with hyperlinks permitting 
navigation among related story segments to a desired hierarchical level representation. 

Ahmed discloses displaying a plurality of related summary story segments (see 
stories for "Headline News" in fig 2-b) with source information (see "Headline News" 
icon 213 on the right) and hyperlinks 215 at the top (see fig 2-b). 

Youman teaches displaying hierarchical levels with a summary of a program 
located at the top of the screen with the source information at the bottom (see fig 24a). 
It would have been obvious from Youman placing the source information on a lower 
level of the screen would have provide a better viewing of the summary since the 
source information would not be in the way i.e. in the lower corner. Therefore, it would 
have been obvious to one having ordinary skill in the art at the time the invention was 
made to modify Ahmed to include the claimed hierarchical level to place the more 
important information like the summary information on top and the source of the 
information on the bottom to provide a more clearly prominent display of the important 
summary information. 

Considering claim 56, Ahmed discloses the claimed information is a text stream, 
the source data is text relating to a story segment and the summary representation 
includes named entities (see fig 2-b, named entities met by "Erin: A Tropical Storm" the 
story segment is met by the summary description of "Erin: A Tropical Storm"). 

Considering claim 57, Ahmed discloses viewing image data (see fig 2-b) and 
thus discloses the claimed "information stream is an image stream". Further, Ahmed 
discloses displaying frames of information including a title and summary (see item 214 
fig 2-b, frame 214 meets "keyframe" limitation). 
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Claim 60 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ahmed (6,263,507) in view of Vora et al (5,819,273) and Ahn (5,696,963), as applied 
to the claims above, and further in view of Niwa et al. 

Regarding claim 60, the combination of Ahmed, Vora and Ahn fails to disclose 
the claimed in response the a search query, presenting a graph of named entities and 
their corresponding frequency of occurrences in story segments over a selected time 
period and the claimed in response to selection of a point on the graph of named 
entities, presenting the user with an overview story segments containing the selected 
named entity. 

Niwa teaches as system which graphically displays keywords and the frequency 
of occurrences noting that words with a higher frequency are presented first or in a 
higher location on the longitudinal axis on the graph (see col 2 lines 15-30). It would 
have been obvious modifying the combination of Ahmed, Vora and Ahn to include the 
claimed limitation would have provide a user with a frequency of named entities 
providing a user with documents, stories, keywords, or keyframes which are most 
relevant. 



I. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Imanaka et al (6,064,952) - Information abstracting method 
Shiomi et al (6,009,439) - Data retrieval support apparatus 
Walls et al (5,848,410) - Selective and continuous index generation 



Conclusion 
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Schultz (5,640553) - Relevance normalization in response to a search query 
Register et al (5,371 ,807) - Method for text classification 

Any response to this action should be mailed to: 



Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
or faxed to: 

(703) 308-9051 , (for formal communications intended for entry) 

Or: 

(703) 308- 5399 (for informal or draft communications, please label 

"PROPOSED" or "DRAFT") 
Hand-delivered responses should be brought to Crystal Park II, 2121 
Crystal Drive, Arlington. VA., Sixth Floor (Receptionist). 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Vivek Srivastava whose telephone number is (703) 305 
- 4038. The examiner can normally be reached on Monday - Thursday from 8:00 am to 
5:30 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Andy Faile, can be reached at (703) 305 - 4380. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the group receptionist whose telephone number is 
(703) 305 - 3900. / s y 



VS 11/19/03 




VIVEK SRIVASTAVA 
PRIMARY EXAMINER 



